Expanding the potential for disk-directed I/O
نویسنده
چکیده
As parallel computers are increasingly used to run scienti c applications with large data sets, and as processor speeds continue to increase, it becomes more important to provide fast, e ective parallel le systems for data storage and for temporary les. In an earlier work we demonstrated that a technique we call disk-directed I/O has the potential to provide consistent high performance for large, collective, structured I/O requests. In this paper we expand on this potential by demonstrating the ability of a disk-directed I/O system to read irregular subsets of data from a le, and to lter and distribute incoming data according to data-dependent functions.
منابع مشابه
Interfaces for Disk-directed I/o
In other papers I propose the idea of disk directed I O for multiprocessor le systems Those papers focus on the performance advantages and capabilities of disk directed I O but say little about the application programmer s interface or about the interface between the compute pro cessors and I O processors In this short note I discuss the requirements for these interfaces and look at many existi...
متن کاملTuning Starfish
STARFISH is a parallel le system simulator we built for our research into the concept of disk directed I O In this report we detail steps taken to tune the le systems supported by STARFISH which include a traditional parallel le system with caching and a disk directed I O system In particular we now support two phase I O use smarter disk scheduling increased the maximumnumber of outstanding req...
متن کاملDisk - directed I / O for an Out - of - core
New le systems are critical to obtain good I/O performance on large multiprocessors. Several researchers have suggested the use of collective le-system operations, in which all processes in an application cooperate in each I/O request. Others have suggested that the traditional low-level interface (read, write, seek) be augmented with various higher-level requests (e.g., read matrix), allowing ...
متن کاملDisk-Directed I/O for an Out-of-Core Computation
New le systems are critical to obtain good I/O performance on large multiprocessors. Several researchers have suggested the use of collective le-system operations, in which all processes in an application cooperate in each I/O request. Others have suggested that the traditional lowlevel interface (read, write, seek) be augmented with various higher-level requests (e.g., read matrix), allowing t...
متن کاملEnwrich: a Compute-processor Write Caching Scheme for Parallel File Systems Apratim Purakayastha 2 Enwrich: a Compute-processor Write Caching Scheme for Parallel File Systems *
Many parallel scientific applications need high-performance I/O. Unfortunately, end-to-end parallel-I/O performance has not been able to keep up with substantial improvements in parallel-I/O hardware because of poor parallel file-system software. Many radical changes, both at the interface level and the implementation level, have recently been proposed. One such proposed interface is collective...
متن کامل